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1 Introduction 


In recent years an increasing number of applications of the multilinear structure of tensors has been 
discovered in several disciplines, e.g. higher order statistics, signal processing, biomedical engineering, etc. 
mmm- In this paper we study the maximal singular value problem for nonnegative tensors which is induced 
by the variational characterization of the projective tensor norm. Let f £ lpix...xd m anc j i < p 1; .... p rn < 
oo, we consider the £ Pl: ‘' J>r " singular values of / defined by Lim [1] as the critical points of the function 
Q: R dl x ... x —y R given by 


Q ( X 1 ; * * * j 

where x.; € R di , || • || p denotes the p-norm and 


|/(xi,... ,x m )| 

|| x l||pi • • ■ • • || x m Wpm 


/(xI,...,x m ) := 


E 


fn. 


X\ 


ii e [d i 


,eK 


with [?r] := 

ll/IU,...,p m - 


{1, The maximum of Q is the so-called projective tensor norm [S] and we write it 

Note that the variational characterization of singular values we use here is slightly different than 
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the one proposed in [J as we have the absolute value in Q which leads to the fact that singular values of 
tensors are all non-negative similar to the matrix case. 

The main contributions of this paper are a Perron-Frobenius Theorem for the maximal singular 

value of nonnegative tensors together with its Collatz-Wielandt characterization and a power method that 
computes this maximal singular value and the associated singular vectors. More precisely, let p' denote the 
Holder conjugate of p and for n £ N, let ip p : —> M n with (^> p (*)). . = | Xj\ p 1 sign(xj) for j £ [n]. Moreover, 
let R” + := {x £ R n | > 0,i £ [n]},§+ + := {(xi,.. . ,x m ) | x k £ R dk , ||x fc || pjfe = 1 and x fc £ R^ + ,k £ [to]} 

and for i £ [to], k £ [to] \ {i},jk £ [<4] let Si t k,j k ■ §++ —> R be defined by 


s i,k,jk ( x ) — V *p 



then we have the following result. 

Theorem 1. Let / £ M . dl *'" xdm be a nonnegative weakly irreducible tensor and 1 < p\,... ,p m < oo such 
that there exists i £ [m] with 

m — 1 < (pi - 1) ( min p k - (m - 1) 

Then there exists a unique vector x* £ § d + such that Q(x*) = ||/|| Pl ,..., Pm . Furthermore, it holds 


max I I mm 

xeS^. + r-i 


hVtjv(' X ) 


Pu~ 1 


[|pi { ™,vl = min II 




(x) 


Pv- 1 


and if / is irreducible then x* > 0 is the unique nonnegative £ Pl ’-"’ Pm singular vector of /, up to scale. 


Note that our theory can be extended so that the maximum (respectively the minimum) in the min-max 
characterization of Theorem |lj is taken over {(x 1 ,...,x m ) | x k £ M dfc + , k £ [to]} instead of § d + . A key 
element of our proof is the construction of a bijection between the l Pl : '"' Prn -singular vectors of / and the 
points x £ := {(xi,... ,Xi_i,x i+ i,... ,x m ) | x fc £ M+ fc + and ||x fc || Pfc = l,k £ [to] \ {*}} satisfying 

s i,k,j k (x) = A p ' i ^ p ' k ~ r> Xkj k for every k £ [to] \ {*} and j k £ [d k ] (see Proposition [H]). Based on this observation 
we also build an algorithm that computes the maximal singular vectors of /, which is in the next theorem. 


Theorem 2. Let / £ 


di X ...Xdrr 


satisfying the assumption of Theorem jlj Let (A(i )ken, {\\.)keN and (: 

' 71 . Mon 
*) = <l> 


be _a nonnegative weakly irreducible tensor and 1 < p ±,..., p m < oo 

fcgN sec l liences produced by 

£ §+ + be a singular vector of 
^x*) where <!>,; is the bijection 


the Higher-order Generalized Power Method (see p 141. Moreover, let x 
/ satisfying Q(x*) = ||/|| Pl ,..., Pm and let (||/|| Pl ,... lP , 
given in Proposition [5] Then 


(ll/ll, 


Vk £ N, A* < A^ 1 < 


\\pi,...,Pm — 


A+ +1 


< A*, 


lim X k _ 

k—t oo 


11 Pi 7 • • • iPn 


lim A* , 


lim x fc = x* 

k—t oo 


and there exists 0 < ^ < 1, k 0 &N and a norm || • ||g such that 

||x fe+1 - x*|| G < ^||x fc - x* ||g Vfc > k 0 
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Note that the computation of matrix norms [B] and tensor norms [7] is NP-harcl in general and thus the 
restriction to nonnegative matrices resp. tensors is crucial. In the case of matrices (to = 2) a power method 
for the computation of a general (pi,P 2 )~ n orm of a nonnegative matrix and its associated singular vectors 
has been considered by Boyd [5] already in 1974. Recently, the paper has been reconsidered by [5] where 
uniqueness of the strictly positive singular vectors is shown under the condition that the matrix is strictly 
positive. Our Perron-Frobenius theorem extends this uniqueness result to irreducible matrices (note that 
the notion of weakly irreducible and irreducible coincide for matrices and reduce to the standard notion of 
irreducibility). 

On the tensor side (to > 2) Perron-Frobenius Theorems for nonnegative tensors have already been 
established for //-eigenvalues [TO] (Pi = to, i = 1 ,...,m) and general HP 1 '- ■’ Pm singular vectors [TT] for 
Pi > m, i = 1,... ,m. Our Perron-Frobenius theorem in Theorem [l] extends the range of (pi,... ,p m ) to 

m - 1 < (pi - 1) I min p k - (to - 1) 

In particular, this allows to have one pi to be arbitrarily close to 1 given that the other p k are sufficiently 
large or alternatively, all except one Pi can be arbitrarily close to to — 1 whereas Pi has to be sufficiently 
large. Moreover, our Collatz-Wielandt characterization seems to be the first one for the case where the pi are 
not all equal. Our result also leads to a slight generalization for the singular vectors of a partially symmetric 
nonnegative tensor introduced in EH which is discussed in more detail in Section [bj 

The power method for tensors was first introduced by Ng, Qi and Zhou in m for the computation of 
the maximal //-eigenvalue of an irreducible nonnegative tensor. It was generalized in m where the method 
can also be used for computing singular vectors for weakly primitive nonnegative tensors. However, 

their method applies only in the case when pi = ... = p m while our higher order power method needs only 
weak irreducibility of the nonnegative tensor and does not require pi,...,p m to be equal. 

Let us describe the organization of this paper. In Section [2] we prove some general properties of the 
£Pi,...,p m singular values of /. In Section[3] we restrict our study to nonnegative tensors and provide criteria 
to guarantee the existence of some strictly positive singular vectoiQof /. In Section[|] we provide our Perron- 
Frobenius Theorem and Collatz-Wielandt characterization of the maximal singular value. We discuss the 
relation between / Pl, - ’ Pm -singular value and other spectral problems for tensors in Section [5] The higher 
order power method together with its convergence rate are introduced in Section [G] Finally, in Section [7] we 
do a small numerical experiment and compare our power method to the one proposed in m ■ 

1 For simplicity we speak in the following of the singular vector even though this corresponds to a set of m singular vectors 
of a m-th order tensor. 
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2 Notations and characterization of the singular spectrum 


For / G / > 0 (resp. / > 0) mean that every entry of / is nonnegative (resp. strictly positive), 

furthermore we write / < g (resp. f <g) if g — f>0 (resp. g — f > 0). Let 9\ d := R dl x ... x R dm , 
we use bold letters without index to denote vectors in 9\ d , bold letters with index i G [to] denote vectors 
in M. di and the components of these vectors are written in normal font, i.e. x G x = (xj,..., x m ), x, G 
R di , x i = • • ■, Xi,di), %i,ji G R. We denote by § d the “unit sphere” in lR d , i.e. x G § d if and only if 

ll x i||pi = 1 f° r every i G [to]. We write p' to denote the Holder conjugate of 1 < p < oo (i.e. ^ + y = 1). 
For i G [m], set y\ d ~ di := R dl x ... x K^- 1 x x ... x and let S d ~ di be the set of x G 9\ d ~ di such 

that [|xfc|| Pfe = 1 for every k G [m] \ {?'}. Furthermore, for n G N and V G {$K d ,S d ,9 I t d_di ,S d_d %]R n } we 
write V + (resp. V ++ ) the restriction of V to the positive cone (resp. to the interior of the positive cone), e.g. 

:= {x G D\ d | x > 0} and := {x G S d ~ di | x > 0}. We follow a similar system of notation as vectors 

for the gradient of /, that is V/(x) G fH d ,V.;/(x) G M di ,d itji f(x) G K, V/(x) = (Vi/(x),..., V m /(x)) 

and V*/(x) = (e?i,i/(x),..., 3 iidi /(x)) where := gyy—. In particular, note that /(x) = (V i /(x),x i ) 
and = /(xi,..., Xj_i, x* + i,..., x m ), where e^p),... , the canonical basis of K di . 

Furthermore, for 5 G R d i x --- X£ C* we denote by |g| G R d ix--- xd m the tensor such that \g\j l! ...,j m = \9j 1 ,...,j m \ 
for every j± G [di] > • • • 5 Jra ^ [^m] • 

For 1 < q < 00 define 4> q : I" 4 R" by (■ ip q (y))j = | 2 /y | 1 sign(j/ J ) for every 1 < j < n. Note that 

V’gO/yOO) = x , IIV’gMIlr = llxll^ 1 .!) and V||y|| g = ||y||Consider the function S : d\ d -4 R 

defined by 5(x) = |!x 1 || pi • ... • ||x m || Pm . 

One can conclude that a critical point x of Q such that /(x) 7 ^ 0 (Q is not differentiable at x if /(x) = 0) 
must satisfy the following nonlinear system of equations 


sign(/(x))Vi/(x) = Q(x)S'(x)||x i || Pi Pl V ; p ! ( x i) Vi G [to]. (1) 

Now, for i G [to] consider 

a,: -4 R di , x sign(/(x))Vy.(Vi/(x)), (2) 

then x G S d is a critical point of Q if and only if /(x) 7 ^ 0 and cq(x) = Q(x) Pi_1 Xi for i G [to]. This 
motivates our choice for the definition of ©(/), the set of critical values of the function Q , as follow: 

©(/) := |A G M \ {0} | 3x G S d with <Tj(x) = A Pi-1 Xj Vi G [m] j . 

The proof of Proposition [ 3 ] resembles the study of ^-eigenvalues in [Ill- 

Proposition 3. Let 1 < pi,...,Pm < 00 and / G K d i x --- xd ™. If / 7 G 0, then ©(/) / 0 and for every 
A G ©(/) we have 0 < A < min i6[m] max,. e[(i j d] /Pi d^iJ{e), where e = (1,1,..., 1) G and / := ]/]. 

Proof. First of all, note that for every x G such that S(x) > 0 we have Q(x) = Q ^ pj ,..., pjp—• 
Thus, ||/|| P1 ,.. ■ iPm = s uPxeS d Q( x ) and since x 1-4 Q(x) is a continuous function on the compact set § d , it 
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reaches its maximum. It follows that ©(/) y^ 0. Let x* G S d be a critical point of Q associated to A € ©(/). 
Let i G [to], then, from ||x*|| Pi = 1, it follows that there exists some j, G [di ] such that |a;* ■. | > d~ X p '. In 
particular, the fact that ip Pi is an increasing function implies = ip Pi (\x *,jj) > 1 Pi 

x* G S d is a critical point of Q. we have |A %p Pi (x*^.)\ = |3 iji /(x*)|. Thus, 


Since 


A = A d] ,Pi 1/Pi = A d 1 i ,Pi %p Pi (d i 1/p ') < d] /Pi \\^ Pi {x*^.)\ = d\' Pi \ < d. 


d/p'i I 


1/P; 


mg, |a,i,/(*’)|. 


Since ||x^.|| Pfc = 1, we must have \x%,j k \ — 1 f° r ever y & G [to] and j*, G [<4], i.e. |x*| < e, where e G 9\ d is 
the vector who’s entries are all 1. Hence, for every Z.j G [di], it holds |9j ) j./(x*)| < di t i i f (|x*|) < di t i i f(e). 
Taking the minimum over all i G [m] concludes the proof. □ 


Note that for every / y^ 0 and every 1 < pi,... ,p m < oo, there exists always at least one singular value. 

Example 4. Let A G R 2x2 be the matrix defined by A\ -| = ^ 2,2 = 0 and A i ; 2 = — = 1. For every 
1 < pi,P 2 < 00 , the vector x* = (^2~n , — 2 _ pi, 2 _ ^ , 2 _ ra ^ G R 2 x R 2 is a ^ Pl,P2 singular vector of H 
associated to the singular value A = 2 pi *>2 . 


We formulate now an equivalent characterization of ©(/). Note that for every z,,y.j G we have 
Vi/(x 1 ,... ,Xi_i,yj,Xi + i,... ,x m ) = Vj/(xi,... ,Xj_i,Zj,Xj + i,... ,x m ), thus we may, without ambiguities, 
abuse notation and write V,/(x) regardless if x G d\ d or x G y\ d ~ di . For i G [to] and x G let S, and 

Qi be the functions defined by S»(x) := ||xi|| Pl • ... • Hxj-illp^Jxj+iHp^ • ... • ||x m || Pm and 

Qi ■■ {x G I S'i(x) > 0} —X M, X H> l|V ‘ /(x)llp - . 

-Si(x) 

Observe that x G ‘d\ d ~ di such that ,S,;(x) y^ 0 and Vj/(x) y^ 0 is a critical point of Qi if and only if it satisfies 


-?i(x) p ‘||x fc ||^ ^ : (V 1 /(x)),V i a tj J(x) = Qi(x-) Pi ip Pk {xkj k ), 


Vfc G [to] \ {z}, j k G [4]. (3) 


Here, we used dij i dk,j k f('x) = dkj k dij i f(x) as / G C ,2 (9I‘ i ). It follows that every x G S d such that 
Vi/(x) y^ 0 is a critical point of Q; if and only if syfc(x) = Qi(x) p ^ Pfe_1) Xfc for every k G [to] \ {«}, where 

Sj.fc: ->1 4 , x e-x ip p * k (v k f (xi,...,x i _i,^ p /(V i /(x)),x i+ i,...,x m ) V (4) 


In the next proposition we show equivalence between the critical points of Qi and those of Q. 


Proposition 5. Let 1 < pi,... ,p m <00 and / G R d i x --- xci m w ith / yf 0, denote by C* C ©(/) x S d the set 
of pairs (A,x*) where x* is a critical point of Q associated to the critical value A. Furthermore, for i G [to], 
let ©,(/) := {AgI\ {0} | 3x G S d ~ di with Sj^x) = A Pi ( pfe-1 )xfc Vfc G [to] \ {*}} and C* C ©j(/) x S d ~ di 
be the set of all pairs (A,x*) where x* is a critical point of Qi associated to the critical value A. Then 

©(/) = ©*(/) and, with q(x) := sign (f (xi,..., Xj_i, (A^ 1 V,/(x)), x J+ i,..., x m ) \ , the function 


<I>, 


C* —X C*, (A,x) i-x ^A, ^x, ..., Xj_i, ^ p / (<Ti(x) A 1 V i /(x)),x i+1 ,...,x m ^ 


is a bijection. 
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Proof. First, we show that <F ? ; is well defined. Let (A,x) £ C* and (A,x*) := <Fj(A,x). Using Equation 
Q, V*/(x) = Vi/(x*),x* = V’p'Mx) A” 1 Vi/(x)) and V id k ,j k f(x.) = Vid k j k f(x*), one can show that 
AT/V( x fc) = ft(x)V fc /(x*) for every fc £ £ [d k ]. Furthermore, sign(/(x*)) = sign( (Vj/(x*),x*}) = 

Q( x )sign (A 1_p i||V i /(x)||^ = q(x) and ||x*|| p . = 1 because ||V ! ;/(x)||^r 1 = Q^x)^" 1 = A^~\ so 

(A,x*) £ C*. Injectivity is straightforward by definition of d>i and surjectivity is shown by noticing that 
if (A,x*) £ C* then (A,x*) = <frj(A, (x*,..., x*_ x , x? +1 ,..., x^)). Finally, the fact that is a bijection 
implies ©(/) = ©*(/). □ 

The previous proposition implies that the maximum value of Qi is ||/||pi,...,p m - Moreover, if we know 
a maximizer of Qi then we can construct a maximizer of Q and vice-versa. This result can be seen as a 
generalization of the variational characterization of the singular values and singular vectors of matrix (see 
e.g. Theorem 8.3-1 ng). 

3 Nonnegative tensors and positive singular vectors 

Now, we focus our study on tensors / £ with nonnegative coefficients, i.e. / > 0. 

Lemma 6. Let / £ and x,y £ such that / > 0 and 0 < x < y, then 0 < /(x) < /(y), 

0 < V fc /(x) < V fc /(y), 0 < a fc (x) < cr fc (y) and 0 < s ijfe (x) < s ijfc (y) for every k,i £ [m] with k ^ i. 

Proof. Straightforward computation. □ 

We recall the definition of irreducible and weakly irreducible tensors. 

Definition 7 (El)- Let / > 0 and G(/) = ( V,E(f )) an undirected m-partite graph with V ■= ({1} x 
[di]) U ... U ({m} x [d m ]) and such that for every k, l £ [m ] with k ^ l, we have ({k,j k ),(hjl)) € E(f) if 
and only if there exist j v £ \d v \ for v £ [m] \ {fe, 1} with fj 1 ,...j m > 0. 

i) We say that / is irreducible if for each proper nonempty subset 0 ^ J C V the following holds: Let 
I = V\J, then there exist ( k,j k ) £ J and (Z, ji) £ I for l £ [m] \ {k} such that fj 1 ,...,j rn > 0. 

ii) We say that / is weakly irreducible if G(f) is connected. 

The next proposition lists some useful properties of nonnegative tensors. 

Proposition 8. For 1 < < oo, / £ R d i x --- xd ™ and a := (ao, &i ,..., a m ) > 0, consider the 

function T a : 93 d — > defined by T a ( z) := a 0 z + (oi<7i( z ), • ■., a m tr m (z)). 

a) / > 0 if and only if a 0 z < T a (z) for every z £ §+. 

b) If / > 0 is weakly irreducible, then Ooz < T a ( z) for every z £ S^ + . 

c) / > 0 is irreducible if and only if there is some n £ N such that T™(z) > 0 for every z £ S^, where T™(x) 

is recursively defined by T”(x) = T” _1 (T a (x)). 

d) / > 0 if and only if T a ( z) > 0 for every z £ §^. 

Proof. Let us recall that z £ S d implies z k 0 for every k £ [m\. 

a) If / > 0 and z £ S^, then, by Lemma [g] Uj(z) > 0 for any i £ [m] and thus aoz < T a (z). Now, 

suppose that there is z £ §+,i £ [m] and ji £ [di] such that (T a (z)) < aoZij t . It follows that 

0 > (T a (z)) - a 0 z itji = ai<Tij i (z) + o 0 Ziji — otoZij i = otiCFi j^ z). Since a, > 0, this is possible if and 

only if dij i f( z) < 0. However, z > 0, so there must be some entry of / which is strictly negative. 
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b) Let / > 0 be weakly irreducible and z e§ d ++ . We need to show that <Jk,j k ( z ) > 0 for every k £ [to] and 

jk £ [dfc]. Suppose by contradiction that there is some i £ [m\ and j t £ [di] such that dij i f( z) = 0. Then, 
from z > 0 and / > 0 follows that = 0 for every jj. £ [dk] and k £ [to] \ {*}, thus the vertex 

(■ i,ji ) is not connected to any other vertex in the graph G(f) associated to /. This is a contradiction to 
the fact that / is weakly irreducible. 

c) Suppose that / > 0 is irreducible and for zgSj let J Zi := {jj £ [df \ = 0} and J z := J Zl x ... x J Zm . 

Note that z £ § d implies J Zi ^ [d,] for every i £ [to]. J Ta ( z ) C J z follows from / > 0 and the property 
discussed above. We show that if J z ^ 0, then J Ta ( z ) is strictly contained in J z . So, suppose J z ^ 0 and 
assume by contradiction that Jt 0 (z) = Jz- Let v £ [to] and j„ £ J z „, then 0 = aoZ u j u + a u cr v j l/ ( z) = 
a v xp Pu (d Zi/ jiy f(z)) and 

Z ljl 

iiG[<ii]\ Ji,... ,ji/-i€[di/-i]\ Jv-i, 

ju+\ e[^i.+l]\L. + l y-..im.£[d'rn]\Jrn 

This implies that for all v £ [m], j„ £ J Zv ,k £ [to] \ {v} and jj. £ [dk] \ J Zk , we have f :h = 0, a 
contradiction to the irreducibility of /. Thus Jr a (z) is strictly contained in J z . Using the fact that z £ E> d 
has at least to nonzero components (because ||zj|| Pi = 1 for every i £ [to]), we get the existence ofneN 
such that T”(z) > 0. Now, assume that there is z £ §^, i £ [to] and jj £ [di] such that (T^(z )). = 0 for 

every k £ N. Suppose by contradiction that / is irreducible. Since / > 0, we must have Zi > j i = 0. Thus, 
if k( z) £ N denotes the cardinality of J z , we have k(z) > 0. But we assumed / to be irreducible and by 
the same arguments as above, for every x £ §{_, if k(x) > 0 , then k(x ) > n(T a (x)). A contradiction to 
k(T„(z)) > 0 for every k £ N. 

d) Suppose / > 0 and let i £ [to], jj £ [dj] and z £ §{.. Since z £ S+, for every k £ [to] there exists some 
jk £ [dk} such that Zk,j k > 0. It follows that 

0 ^ * • ■ • %i —* ... * Z m j rn £ dijJ(z) \/ji £ [di] 

and thus atj^z) > 0. This is true for every i £ [to] and jj £ [dj], thus 0 < (aicri(z),... ,a m a m ( z)) < 
T a ( z). Now, suppose that there exist l\ £ [di],..., l m £ [d m ] such that < 0. Consider the vector 

z defined for every k £ [to] and jk £ [dk] by Zkj k = (di — 1 ) _1 /pi if k = 1 and ji ^ l \, Zk,j k = 1 if 
k d* 1 and jk — ^k : j k — d else. I iie 11 z ^ §+,■ 21 ,ii = 0 and di,ij(z) = < 0. It follows that 

(.Tol (z))< 0- El 

Note that it is proved in Lemma 3.1, m, that every irreducible tensor is weakly irreducible. The next 

example shows that the reverse implication of Proposition [ 8 j [bj is not true in general. 

Example 9. Let / £ R 2x2x2 be defined by /i.i,i = = 1 and zero else. Then, for every x > 0, we have 

V/(x) = (x 20 x 3 ,Xi 0 x 3 ,Xi 0 x 2 ), where o denotes the Hadamard product. If T a is defined as in Proposition 
[ 8 j then T a (x) > aox for every x > 0 , however / is not weakly irreducible. 

Corollary 10 . Let / > 0 be a weakly irreducible tensor and 1 < pi,... ,p m < 00 , then for every z £ 
and i,k £ [to] with i ^ k, it holds Sj,fc(z) > 0. 

Proof. Let / > 0 and z > 0, then Sj,fc(z) = <ik (zi,..., Zj_i, tjj(z), Zj + i,..., z m ). It follows by Proposition | 8 j 

[b]) that (jj(z) > 0 and thus also Sj j fc(z) > 0 . □ 

Corollary 11. Let / £ R d i x --xd m w j^j 1 / ^ 0, 1 < pi,...,p m < 00 ,(A,x*) £ C*,(fi,y*) £ C* and 
<L>j : C* —y C* as defined in Proposition [5] 

i) If (A, x*) > 0 and / > 0, then $,(A,x*) > 0. 

ii) If (A, x*) > 0 and / > 0 is weakly irreducible, then $j(A, x*) > 0. 


■ - - i - ... - z rn ^j m 0 

-V- - - y 

>0 
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iii) If (/by*) > 0 , then 1 (p,y*) > 0 . 

iv) If (<u,y*) >0, thenar 1 ( M ,y*) > 0. 

Proof. [I]) follows from Proposition [ 8 j [a]). |h]) follows from Proposition [ 8 ] [b]). Finally [iii]) and 0 follow from 
the definition of <Fj. □ 


As we need the existence of some x* > 0 such that Q(x*) = ||/|| Pli . Pm for the Collatz-Wielandt analysis, 

we provide here a few conditions on / and 1 < pi,... ,p m < oo in order to guarantee it. 

Lemma 12. Let f > 0 and 1 < pi,... ,p m < oo, then there exists some singular vector x* G 91+ of / such 
that ||/|| Pll ..., Pm = Q(x*). 

Proof. Existence of x* G S d such that /(x*) = ||/|| P i,..., Pm follows from the proof of Proposition [ 3 ] Since 
/(x) < /(l x l) and S'(lxl) = S(x) for every x G 93 d , x* := |x*| > 0 is also a maximizer of Q , i.e. Q(x*) = 
\\f\\pi,...,p m - By definition, the singular vectors of / are the critical points of Q and thus x* is a singular 
vector of / associated to the singular value ||/|| Pl ,..., Pm - □ 

Theorem 13. Let 1 < pi,... ,p m < 00 and / > 0 an irreducible tensor. If x G § d is a singular vector of /, 
then x G §+ + . Moreover, there exists a singular vector x* G S d , of / such that Q(x*) = ||/|| Pl ,..., Pm - 

Proof. By Equation 0 we have a Ax) = X p ' 1 x for every i G [m], where A = Q(x) is the singular value 
associated to x. From Proposition 8 we know that, with a = A(l, A 1_Pl ,..., A 1_Pm ), there is some nGN 
such that 0 < T"(x) = x. Existence of x* > 0 follows from Lemma [l2| and the discussion above. □ 


Using a similar argument as Friedland et al. (Theorem 3.3, [TT]), we show that if there is * G [m] such 
that (m — 1 < pk for every k G [m] \ {*} and f > 0 is weakly irreducible, then there exists a strictly 

positive singular vector associated to the maximal singular value of /. First, we recall a Theorem proved by 
Gaubert and Gunawardena. 

Theorem 14 (Theorem 2, [H]). Let F : R+ + —> M"+. For t > 0 and J C [n] denote by u J (t) = 
( u{(t ),... G the following vector: uf (t) = 1 + t if i G J and uf (t) = 1 if i ^ J. The di-graph 

G{F) = ([n],f (F)) associated to F is defined as follow: (k,l) G £(F) if and only if Hindoo Fk{u^(t)) = 00 . 
If F(x) < F(y) for every 0 < x < y, F is positively 1-homogeneous and G(F) is strongly connected, then 
there exists A > 0 and x G R+ + such that F(x) = Ax. 

Lemma 15. Let 1 < p lt ... ,p m < 00 , / G M. d i x --- xd ™ an d j, fc G [to] with i 7 ^ k, then 

( \ PiiPk- 1 ) 

0 e\~ Pk s iik (x) V6»i,...,6» m G K++,X G m d ~ di . 

leHM'I / 

Proof. Follows from a straightforward computation. D 


Theorem 16. Let 1 < p±,... ,p m < 00 and / > 0 be a weakly irreducible tensor. Suppose that there is 
i G [to] such that (to — 1 )p[ < p k for every k G [m] \ {*}, then / has a strictly positive singular vector x* > 0 
so that Q(x*) = ||/|| Pll ..., Pm . 

Proof. Let Ai : 91+ _<ii -> 93+ _<li be defined by A, ; (x) := (A itl (x),..., A i)i _ 1 (x), A iji+1 (x), ..., A+ m (x)) with 


Vfc G [to] \ {i} and j k G [d k ], 


where p max : = m a x fee[m]\{i} Pfc- We say that a vector x G 93 d di is an eigenvector of At if x 7 ^ 0 and there 
exists A G 1 such that A,;(x) = Ax. Suppose that we can prove the following. 
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i) Ail^d-di satisfies all assumptions of Theorem |7lj 


ii) If x* £ 93 d + ; and y £ 93 d i \ {0} are such that Aj(x*) = Ax* and A,(y) = fi y then fj, < X. 

iii) If x £ 93 d £ di is an eigenvector of A.j associated to a strictly positive eigenvalue A, then it is a critical 
point of Qi associated to the critical value A^ Pmax_1 ^ Pi . 

iv) If x £ S d “ di is a critical point of Qi associated to A, then A;(x) = A p</, *- Pmast_1 ) X . 

Using |T|) , we may apply Theorem 14 and get the existence of x* > 0 such that A*(x*) = Ax*. |fi]) ensures that 
the associated eigenvalue A is maximal. By unj, we know that x* > 0 is a critical point of Qi. Now, suppose 


by contradiction that A^ Pmax = Qi(x*) < \\f\\ Pl ,...,p m - Lemma 12 and Proposition [ 5 ] imply the existence 
of y* > 0 such that Qi(y*) = ||/|| pi ,...,p m . By [Iv]) , we know that y* is an eigenvector of Ai associated to 
1 ' ) > A, a contradiction. Finally, since / is weakly irreducible we know from Corollary [ll] that 
\\ Pl ,...,p m , x*) := $i(||/|| Pli ... i p Tn ,x*) is such that x* £ 93 d is a strictly positive singular vector of / with 
Q(x*) = ll/Hp!. . Now, we prove Q -[vv\. 

i) The fact that Ai is positively 1-homogeneous follows from Lemma 15 If 0 < x < y, then Aj(x) < Aj(y) 
follows from p max — Pk > 0,Pk — p'^rri — 1) > 0 and Lemma [6] In order to prove the remaining property, 
that G(A.i) is strongly connected, we use the fact that / is weakly irreducible. So, let t/(A, ; ) = (V,£(Aj)) 
and G(f) = ( V,E(f )) (see Definition [7] and Theorem |l4| with V := ({1} x [c^]) U ... U ({* — 1} x 
[di-i]) U ({« + 1} x [d i+ 1 ]) U ... U ({to} x [d m ]) and V := ({1} x [rfi]) U ... U ({to} x [d m ]). We 
show that for every k,l £ [to] \ {«}, if ((k,jk),(l,ji)) £ E(f) then ((k,j k ),(l,ji)) £ £(A*) and if 
((k,jk),(i,ji)),((i,ji),(l,^l)) £ E(f), then ((k,j k ),(l,vi)) £ £{Ai). Since G(f) is an undirected con¬ 
nected graph (/ is weakly irreducible) this would imply that 1?(A,) is strongly connected. By definition, 
((k,jk), (l>ji)) £ E(f) implies the existence of j s £ [d s ] for s £ [to] \ {k, 1} such that > 0 and 

if u't^’- Ji )l(t) > 0 is defined as in Theorem 14 then d k ,j k f( uBU)}(t)j —» 00 as t —>■ 00 . It follows by 
Proposition Kd Ibh and the definition of Si A that Ai ik ,j k ( uWdO}(£)) —y 00 as t —> 00 . Now, suppose that 
((kjk),{i,ji))7{{i>ji)i(h v i)) £ E(f), then there exists j a £ [d s ] and v t £ [d t \ for s £ [to] \ {k,i} and 
t £ [to]\{/,*} such that > 0 and > 0. Again, let uLWdlfi) > 0 be defined 

.. jI/m > 0 implies that dij i f(u^ l ’ l/ ^}(t)) 


as in Theorem 


14 


then /, 




00 as t 


and 


fA,—dm > 0 implies that 

w(uP* )} (i),...,^ ,u«^ )} (t),...,u^)>(t)) -4oo, 

as t 00 . It follows that A ijk j k —► 00 as t —> 00 , i.e. ((k,j k ), (l, v i)) £ £(Aj). Thus A* 

fulfills all assumptions of Theorem [14} 

ii) This result follows from Lemma 3.3 in .El- We reproduce the proof here for convenience of the 
reader. Let x* £ 93 d + d< and y £ 93 d ~ di \ {0} be such that A*(x*) = Ax* and A,;(y) = jiy. Set 


9 := 


{I Vkjk > 0, k £ [to] \ {i},jk £ [<4]1, then 9 > 0 and 9y < x*. We observed in 
l VkJ k ’ J 


that Ai 


is positively 1-homogeneous and 0 < x < y imply Aj(x) < A,;(y). It follows that for every n £ N, we 
have 9p n y = 0A”(y) = A”(0y) < A"(x*) = A”x, where A*(z) := A}' _1 (Aj(z)) for k £ N, k > 1 and 

z > 0. This shows that if A < 1, then 9y < lining,*, x = 0, a contradiction to y £ 93 d_di \ {0}. 
iii) Let x > 0 be an eigenvector of A, associated to the eigenvalue A > 0. Note that Aj(x) = Ax implies 


A P»ax i x p^ = || Xfe || p * Pi(m i:> ^ Pk (si t kj k (x)) Vfc £ [to] \ {i},jk £ [d k ]- (5) 

Multiplying this equation by x k ,j k and summing over j k £ [d k \ shows 

A P»ax-l|| Xfc ||Pfc = || Xfe ||^ _Pi ( m_1 ) (V’pjfc (Si,fc(x)),X fe ) = llXfcllS^^^IIVi/Wllp' Vfc £ [™\ \ W> 
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where we used (ip Pk (s»,k(x)) , x fc ) = /(xi,. .. ,Xj_i, Oj(x), x i+1 ,... ,x TO ) = (Vi/(x)), 

Thus ||x fc ||£‘ (m-1) = ||Vi/(x)||^A 1_Pm “ for every k G [to] \ {*}, i.e. ||xi|| Pl = ... = ||x m || Prn =: a 
and we have a^x G S d_di . Now, substituting x by x = a~ 1 x in Equation ([ 5 ]) and composing by ipp^ 
shows A(?»»*- 1 ) 04= s ijfejfc (x). By Equation © it follows that x is a critical point of Q k . Since 
the critical points of Qi are scale invariant, x = ax is also a critical point of Qi and <3i(x) = A^ max_1 ^ /,pi . 

iv) Suppose that x G S d + ~ di is a critical point of Qi and let A > 0 its associated critical value. Since x G S d di 
is a singular vector of /, by Equation © we have s,; j fe(x) = \ p dPk ^x*, for every k G [to] \{z}. It follows 

x kTjT ~ Pk (^ Pi Pfc_1 j = A Pi ^ p ™*-^Xk,j k , i.e. X is an eigenvector 

of Ai associated to the eigenvalue A Pi /( pmax_1 ) >0. □ 


4 Collatz-Wielandt analysis and proof of the main Theorem 


For i G [to], consider 7 ^ , 7 +: §^ + dl 


*++ 


, the Collatz-Wielandt ratios defined as follow: 


7 < (*) — n 


fce[m]\{i} 


mm 

jk£[dk] 


i,k,jk ( x ) 

x k,i k 


Pk -1 


and 7 l + (x):= | j 


fc£[m]\{i} 


max 

jke[d k ] 


i,k,jk ( x ) 

X kJk 


Pk -1 


( 6 ) 


The next lemma is useful to prove the uniqueness of the strictly positive singular vector of / in our Perron- 
Frobenius Theorem. 

Lemma 17. Let / > 0 be a weakly irreducible tensor, i G [to] and x,y G 9\ d ~ di . Assume 0 < x < y and 
x 7 ^ y, furthermore consider the following sets for u G [to] \ {z}: J u := {j v G [d v ] | x v ,j v = yv,j„}, Ji '■= {ji G 
[dj] | < 7 iJi (x) — Hi-j-, (y)}, Iv — {jv £ \dv\ | Si,v,jv (x) — Si,v,jv (y)} , li — Jit J — ({l}x<7l)U...U ({to} X J m ] 
and I ■= ({1} x Ji) U ... U ({to} x 7 m ). Then I C J and if J 7 ^ 0 we have 7 7 ^ J. 

Proof. First, we prove 7 C J. If I = 0, there is nothing to prove, so suppose 7^0. Let (l,ji) G I 

with l G [to] \ {z}, weak irreducibility of / implies the existence of jk G [dk] for each k G [to] \ {1} such 

that > 0. So, 8 it i tjl (-x.) = s i: i tjl ( y) implies 07 ^ (x) = a idi ( y) because 0 < x kJk < y k>jk for every 

k G [to] \ {IQ}. Now, (JijQx-) = VijQy) implies Xij t = yij t since 0 < x k j k < y k j k for every k G [to] \ {l,i}. 
Thus {l,ji) G J and we have I C J. Now, suppose J 7 ^ 0, then x/y implies the existence of l G [to]\{z} and 
ji G [di] such that a 77 , < yi,j t - Since / is weakly irreducible, there exists j k G [d k \ for each k G [to] \ {/} such 

that > 0. It follows that 077 (x) < 077 ( y) and thus 7, 7 ^ [d;] as well as 5 * 7,7 (x) < Si }kt j k (y) for 

k G [to] \ {z}. Hence, I k 7 ^ [d k ] for every k G [to]. Now, on one hand, if there is k G [to] such that J k = \d k ], 
then I k 7 ^ J k and the proof is done. On the other hand, if there is k G [to] such that J k = 0, then 7; = 0 for 
every l G [zrz] \ {z} and the proof is done. Finally, assume that J k ^ {[dfe], 0} for every k G [to]. Suppose by 
contradiction that I = J. Weak irreducibility of / implies the existence of a vertex between J and V \ J in 
the graph G(/) = i.e. there exists u, p G [m],v 7 ^ p,j* G J„, j* G [d M ] \ Jp and jl G [d k ] for each 

k G [to] \ {v, y} such that >0. If v 7 ^ z, Si M j*(y) = si,v,j*( x ) follows from v G J v = 7„ and thus 

= x p,j*t a contradiction to j* G [d p ] \ J^. If v = i, the equality CTij*(y) = <Jij*(x) implies the same 
contradiction. □ 


Note that the assumption 0 < x in Lemma 17 can’t be replaced by 0 < x, S}(x) 7 ^ 0 as shown in the 


following example. 


Example 18. Let 1 < Pi,P 2 ,P 3 < 00 Q = 3 and / G R 2x2x2 the nonnegative weakly irreducible tensor 
defined by = f 1;2 ,i = / 2 , 2,2 = 1 and f n j 2 j 3 = 0 else. Let x := ((1,0), (1,0)) and y := ((1,1), (1,0)) G 
R (6-2) , then 0 < x < y,x 7 ^ y and SQx) = ||(1, 0)|| Pl ||(1,0 )|| P2 = 1. However, s 3 j i(x) = (1,0) = S 3 ,i(y) and 
^ 3,2 (x) = (1,1) = S 3 j 2 (y), thus, if 7 and J are defined as in Lemma [TT] we get JC7. 
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Theorem 19. Let / be a nonnegative weakly irreducible tensor and 1 < p\,...,p m < oo are such that 
there exists i £ [to] with (m — 1 )p' i < pk for every k G [to] \ {z}, therefore there exists x* £ S d ^ li such that 

Qi(x*) = ||/|| Pl ,..., Pm - Let 7“,7j + as in Equation 0, then for every z £ 8++^ we have y“(z) < ||/|| p d ™~^ < 
7 ? + (z) and equality holds if and only if x* = z. 


Proof. First of all, note that, by Theorem 16 we know that there exists some singular vector x* £ S d of / 
such that x* > 0 and /(x*) = ||/|| Pl ,..., Pm - Using the bijection d>, ; of Proposition [5] and Corollary 11 we get 
the existence of x* £ § d ~ di such that x* > 0 and Qy(x*) = 

/ s - i, ■ (x*'> \ P k ~ ^ 

follows 1 




( . From Equation ([df and x* £ S! 


d—di 

'++ 


( Sj, k . Jfc (x*) \ ‘ 
\ X k,ju ] 




for all k £ [to] \ {z} and every jk £ [dyf . In particular, this implies 

that 7”(x*) = Wffpl^-pl! = 7+(**). If z = x*, then 7 "(z) = 7 "(x*) = [|/[|^j™^ = 7+( x *) = y+O^and 
the proof is done. Suppose that z/x* and for l £ [m] \ {/<}, let 0[ := min ;;e [ d( ] and 0; := maxj ie [ d( ] x P l , 


then 0/x* < z ; < 0 ; xand 0; = ||0 ; x;l|| P! < ||zi|| Pi = 1 < ||© z x^|| Pj = 0j, i.e 8i £]0,1] and 0; £ [l,oo[. 
Observe that Lemmas [6] and [15] imply 


yle[m]\{i} 

Moreover, 


Pi / \ p i 

II ° l ] Ok 1 ( z )) < f II 0 H 0 fc 1 ^Pki^kj^x*)). 

\ie[m]\{i} J 


(m— l)p^ 


n n «■ = n s - 


/c£[m]\{i} \ \j£[ra]\{i} 


ii£[m]\{i} 


n °k i )= n e i 

ifce[m]\{i} / ie[m]\{i} 


771— 1 )Pi — 1 


and the same holds if we replace 8i by 0;. The assumption (to — l)p' < pk guarantees 0 0! ^ Pi Pk < 1 < 
Qpn 1 )Pi Pk £ or ever y [to] \ {*}. Now, if 8i = 1 for every l £ [to] \ {z}, then z; = x* for every l £ [m] \ {*}, 
a contradiction to x* z. For the same reason, we can’t have 0; = 1 for every l £ [m] \ {z}. Hence, there is 
some l, k £ [m] \ {z} such that 8i < 1 and 0*. > 1. Thus 0;X ; * y^ z; and z fc y^ 0feX^.. Applying Lemma [l7| to 
0 < (0ix*,..., OjnX^) < z and 0 < z < (0ix][,..., 0 m x^), we get the existence of p, v £ [to] \ {z}, £[d p ] 

and 7,7 £ [dJ such that 8 u x* and Q v x* .+ = 2 ,. ■+, as well as 


8 i,H,-( SlX i--^™ 3 0 < 8 i W ;-(z) and S i,^ 7 +( Z ) < ( 7 ) 


•+ •- 


Furthermore, for each l £ [m] \ {/i, zyz} there exists indexes j, + , j, £ [dj] such that 0;:r* = 2 , and 

^ i3i 

e ' x li+ = z kit by construction of 0; and 0;. With Lemma joj we get 


■j—r ^Pl Kt,j,~( Z )) 

zeMUO M’ur'* 


> i n 

. ie[m]\{z} 


(m-l) P '- Pi 


n 

de[HVW 


^p»( a i.j,j,-( x *)) 

i’pi&lj-) 


> 


■j r ^ ( 3 i,t,j,-( X *) ) 


ip'!™- 1 ) . TT ^P»( a i,i,3, + ( Z )) 


ZG[m]\{i} 


PI —1 


where we used Equation ([7]) for the strict inequalities. Observing that 

7+(z)> n = n ( Sj:ML ^- 

shows 7 +(z) > > 7-(z). 


and 


T-r ^(s Mj +(z)) 

11 7,(7^ 

ieH\w UwUzj+J 


a 
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Corollary 20. Let / > 0 be a weakly irreducible tensor and 1 < pi,... ,p m < oo are such that there exists 
i £ [m] with (?n— l)p[ < pu for every k £ [m]\{*}, therefore there exists x* £ * with Qi(x*) = ||/||pi,...,p m - 

Then x* is the unique critical point of Qi in Moreover, if / is irreducible, then x* is the unique critical 

point of Qi in S d ^ di _ 


Proof. Suppose that y* £ S+ + di is a critical point of Qi. By Equation ([3]) we know that 


Qi(y*) Pi for every k £ [to] \ {*} and jk £ [<4]. Thus, Theorem 19 implies y* = x* since Qj( y*) p 'd m 1 ) = 


[MjA yf) 

y k,ju 


Pk~ 1 


% 


(y*) < < 7+(y*) = Qi{y*) Pi ^ m Now, suppose that / is irreducible. By Theorem 
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we 


know that every nonnegative singular vector of / is strictly positive. Since x* is the unique singular vector 
of / in Sl+, it is also the unique singular vector in Si. □ 


As shown in the next example, there are weakly irreducible tensors with nonnegative singular vectors. 


Example 21. Let / £ 


2x2x2 


be the tensor of Example 18 and 1 < Pi,P 2 ,P 3 < oo such that there is * £ [3] 

there exists a singular vector x* £ S^ + of /. 
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with 2 p\ < pk for every k £ [to] \ {*}. Then, by Theorem 

However, note that y* := ((0,1), (0,1), (0,1)) £ is also a singular vector of /. 


Now, we discuss the assumptions made on pi,... 7 p m in Theorem |19| 

Remark 22. Let 1 < pi,... ,p m < oo and i £ [to], then 

(to — 1 )p'i < min pk to — 1 < (pi — 1) ( min pk — (to — 1) 

fce[m]\{i} \ fc 6[™]\{*} 

Furthermore, if there exists i £ [to] with (to. — 1 )p' i < pk for every k £ [to] \ {*}, then at least one of the 
following condition is satisfied 

a) (to - 1 )p' l < pk , for every k £ [m] \ {»}, where pi = min fce [ m ] p k , 

b) (to - 1 )p' n < pk , for every k £ [m] \ {z}, where p n = max fee [ m] p k . 

Moreover, note that if (to — l)p' < pk for all k £ [to] \ {z} and to > 3, then 2 < (to — 1) < (m — 1 )p[ < pk for 
every k £ [to] \ {*}. In the case to = 2, we may also always choose i £ [to] such that pk > 2 for k £ [2] \ {z} 
because p[ < P 2 is equivalent to p' 2 < pi which is true if and only if 1 < (pi — l)(p 2 — 1). Thus we recover the 
matrix case as analyzed by Boyd [8]. Note however that our result implies that the strictly positive singular 
vector is unique. Bhaskara et al. [S] proved the uniqueness of the strictly positive singular vector but only 
for the case of strictly positive matrix. 

Proof of Theorem [7] The min-max characterization follows from Theorem |19| The uniqueness par follows 
from Proposition [5] and Corollary [20| □ 


5 Relation with other tensor spectral problems 

It is well-known that if a matrix is symmetric, then its eigenvectors and singular vectors coincide up to 

sign. This observation can be extended for tensors as shown in the following proposition. 

Proposition 23. Let qi,... ,qk £ N \ {0} such that q± + ... + q^ = m and / £ K d i x --- xd m with d-\ = ... = 
d qi = di,d(, 1+1) = ... = d( 9l+92 ) = d 2 ,.. •, d( 9l+ ..._|_ ?fe _ 1+1) = ... = d (9l+ ... +9fc) = d k . Suppose that / is 
partially symmetric in the sense that 

fjlT.-ijm f<7\ (il,...,i, 1 ),a- 2 (i(, 1+ l),... ,j(, 1+92 ))... -. a k (j(gi +■ ■ -+9fc_ 1 + 1) ’■ ■ ■ d(qi+.. ) 
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where, for i = 1,..., k, <Ji is any permutation of qi elements. Then, every solution (A, xi,..., x*,) £ (R \ 
{0}) x R'* 1 x R^ 2 x ... x R^ m of the problem 

/ V( gi+ ... + g i _ 1+ i ) /(xi,...,xi,x 2 ,...,x 2 ,...,x fc ,...,x fc ) = \ip Pi (yLi) i = l,...,k, , . 

l || Xl || #1 = ... = ||x fe ||p fc = 1, 

where 1 < p\,...,pk < oo, induces a £ pi >--->Pm singular vector of / with p\ = ... = p qi = Pi,P( qi +i) = ... = 
P( qi+ q 2 ) = P 2 , • ■ ■ ,P(q 1+ ...+q k _ 1+ 1 ) = ... = P(g 1+ ... + g fc ) = Pk■ In particular, if / and p 1 ,...,p m satisfy the 
conditions of Theorem [lj then there is a unique strictly positive solution (A*,x*,... , x£) to Problem © 
If / is irreducible, this solution is also the only nonnegative solution. Moreover, if (A*, x*,..., xj^) is the 
unique strictly positive £ Pl ’" ’ Pm -singular vector of /, then (A,xJ,x^ i+1 j,... ,x* gi+ +qk 1+1 )) is the unique 
strictly positive solution of ©■ 

Proof. For (y l7 ..., y k) £ R dl x R d2 x ... x R dm , consider the injective map 

£(yi,---,y k) ■= (yi,■ ■ ■ ,yi,y 2 ■ ■ ■ ,y 2 ,■ ■ ■ ,yk,■ ■ ■ ,Yk) e R dl x ... x R dm , 

qi times q 2 times qk times 

and the surjective map 

C(zi,... ,z m ) := (z 1 ,z ( g 1+1) ,...,z ( g 1+ ... +gfc _ 1+1) ) £ R dl x R d2 x ... x R dm 


defined for (z l5 ..., z m ) £ R dl x ... xR dm . Note that C(£(y)) = y for every eR^ 1 x ... xR^ m . If (A, x 1; ..., x*.) 
is a solution of ([8]), then the partial symmetry of / and the definition of £ imply 

V(g 1+ ... + g i _ 1+ ; ) /(£(xi,...,x fe )) = V ( g 1+ ... + g._ 1+1) /(^(xi,...,x fc )) = A ^(x*) 

= A ,x fc ) ( g 1+ ... + g._ 1+i) ) vz = 1,.. = 1,. ,.,k. 


This shows that £(xi,..., x*,) is a £ Pl ’ -’ Pm -singular vector of / associated to the singular value A. On 
the other hand, if £(xi,..., x*,) is a £ Pl ’ "■ >Pm -singular vector of /, then, from Equation Q, we know that 
(xi,...,Xfc) is a solution to Problem Now, suppose that / and p\...., p m satisfy the conditions of 
Theorem [l] The existence of a strictly positive solution (A*, x*,...,x£) to Problem ([8), can be shown 
in the same way as Theorem 16 by considering the map A;: R dl x ... x R dfc —> R dl x ... x R dfc with 


Aj := (Ajp,..., Aj ( fc) and A,^ (x) := £ ^A^*, (£(x)) ^ instead of the function A,; defined in the proof of Theorem 

16 (note that the partial symmetry of / implies £(Ai ; fc(x)) = Aj > jj,(£(x)) for every x £ R dl x ... x R dfe ). 
"Now, we show the uniqueness of a strictly positive solution. Let (A, xi,..., x*,), (/x, Ui,..., Ufc) be two strictly 
positive solutions to ([8]). By the uniqueness result of Theorem [l] we know that A = /x and £(xi,..., X;,,) = 
£(ui,..., Ufc). (A, xi,..., Xfc) = (/x, ui, • ■ ■, Ufc), follows then from the injectivity of £ and thus there can be 
only one positive solution to Problem ([8]). If / is irreducible, a similar argument shows that there can be 
only one nonnegative solution. Finally, suppose that (xq,..., x m ) is the unique strictly positive < Plr " ,!,m - 
singular vector of / and assume that there exists a strictly positive solution (x*,... ,x£) to (|8j, we must 

□ 


have £(xj,...,x*) = (xi, 


l ) and thus £(xi 


,) = (x^,...,x*). 


Note that the partial symmetry assumption of Proposition [23]is crucial as shown by the following example. 

Example 24. Let / £ R 2x2x2 with f\, 2.2 = / 2 ,i ,2 = 0 and fi^,i = 1 else. Let 1 < p < oo, k = 2, qi = 1 and 
q 2 = 2. Set Xi = x 2 := (^, ^yy), then V 1 /(x 1 , x 2 , x 2 ) = V 2 /(x 1 ,x 2 , x 2 ) = 23/ p_i and thus 

( 2 3 /p-i ,xi,x 2 ) is a solution of ([s]). However V 3 /(x i,x 2 ,x 2 ) = , 2s>o>- 1 ' ), i.e. (xi,x 2 ,x 2 ) is 

not a £ p,p,p -singular value of /. 

Problem ([8]) models many of the eigenvalue problems for tensors. In particular if k = 1, then we 
recover the Lf-eigenvalue problem for p = m and the Z-eigenvalue problem for p = 2. These problems 
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Higher-order Generalized Power Method (HGPM) 

Input: f £ anc i p 1} ... : p m satisfying assumptions of Theorem [lj e > 0. 

Initialization: i £ [ to ] with ( m — 1 )p' i < p^ for all k £ [ to ] \ {*}. (if m = 2, choose i £ [to] with 
Pi < Pk for k £ [2] \ {*}), x° > 0 with [|xP|| P j = 1 for l £ [to], k = 0. 

Do 

z k = (s it i(x fe ),..., s M _i(x fc ), s M+ i(x fc ),.. ., s iim (x fe )) 


a - +i = n 


Xii 


p'Am- 1 ) 




jie[di] \x$ 


, A(j. +1 = max 




p'Am- 1 ) 


( »f 

\ ll*f II* 


- 1 


RIJklG ll z ?+ilk+i’"‘’M 


2e[m]\{i} 
) 


V xf. 


k = k + 1 


Until (A+ - A* ) < e 

Output: Approximate of the maximal singular vector x := ^x(',..., x*_i, | A 


approximate of the maximal singular value A := /(x). Moreover, 


' i -*- 2 - 1 - 1 5 * * • 5 ■ A -m 


and 


Al+A“ 


llPlv.Prr 


< e. 


(Ji is defined in Eq. n> , p- 1 and Si t k is defined in Eq. H , p- ¥ to select i £ [to] see Remark |22[ 


were introduced in 2005 by Qi PS- Still for k = 1, the more general problem for 1 < p < 00 is known as 
f p -eigenvalue problem and was introduced by Lim in [3]. In ns, 0 and m , a Perron-Frobenius Theorem 
is proved for ^-eigenvalues of tensors. The requirement on p is p > to and is equivalent to the condition of 
Theorem [l] when pi = ... = p m . The case k = 2 and pi = P 2 — 2, is known as M-eigenvalue problem and 
was introduced by Chang, Qi and Zhou in m- The more general formulation for k = 2 and 1 < pi , P 2 < 00 
is known as P 1 ’^ 2 -singular value problem for rectangular tensors and was introduced by Ling and Qi in |12j . 
Ling and Qi also proved a Perron-Frobenius Theorem for £ Pl,P2 -singular value problems and the condition 
on p\ , p 2 is pi,p 2 > to. This condition is equivalent to ours whenever q\ {l,m — 1}, nevertheless, for the 
case q\ = 1, we only require to — 1 < (p\ — l)(p 2 —to — 1) and for the case q\ = m — 1, our condition becomes 
to — 1 < ( p2 — l)(pi — to — 1). 

6 Computation of the tensor norm and singular vectors of a nonnegative tensor 

We derive now an algorithm which takes benefit of the theory developed above. More precisely, motivated 
by the properties of 7 “, 7 + in Equation (j 6 j, we study the sequence (x fc )fc 6 N C E> d ~ di produced by the Higher- 
order Generalized Power Method (HGPM). The HGPM is a tensor generalization of the algorithm proposed 
by Boyd in |5] for matrices (they coincide for m = 2). In order to prove the convergence of the sequence 
(x fc )fc g pj produced by HGPM, we show first that if the starting vector x° is close enough to the singular 
vector x* > 0 then we have linear convergence. Then, we show that for any starting point x° £ the 

sequence converges to x*. Let G : —> §++ di be defined by 

r( N , = ( Si, l( X ) S»,m(x) A 

1 \||Sj 1 i( x )||p 1 ’ ||Si,m(x)||p m y ’ 
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Note that if / is weakly irreducible, by Corollary 10 G is well defined and for k £ N we have x fe+1 = G(x fe ) 
where (x fe )fe £ fsj is the sequence produced by HGPM. Furthermore, if x* is a strictly positive critical point 
of Qi , then G(x*) = x*. The next proposition gives some properties of the sequences {X^ken, {^+)ken 
produced by HGPM that motivate our choice for the stopping criterium. 

Proposition 25. Let / £ K d i x - x ' i ™, / > 0 be a weakly irreducible tensor, 1 < pi,... ,p m < oo such that 
there exists i £ [m] with (to — 1 )p[ < pk for every k £ [to] \ {*} and 7 “, 7 + as in Equation (JgJ) . Furthermore, 
consider the sequences {X^ken and (Ai)fc £ N produced by HGPM, then 


A_ < A 


fc+i 


< 


|| Pl ,..., Pm < At +1 < A* 


\/k £ N, 


and when the Algorithm stops we have 


A£+A“ 

2 


< £. 


Proof. The proof is in two steps, first we prove that r y i (z) < 7 f (G(z)) < ||/||p^™, p ^ < it ( G ( z )) — 7 t( z ) 


for every z £ §(|_ + i and then we conclude the proof. Let k £ [to] \ {i},(f>k ■= min 


Z ) 


s i,k.j k (z) 
jke[dk] ZkJk 


p k := max jte[4] 
and z kPk > Si t k(z). Note that 


, then we have 7i (z) = IIfc e [m]\{i} <t?k t z kh < s i>k ( z), 7 + (z) = rLe[m]\{i} Pk 


and 

Pfc —1 


0 < 


4>k 


I Si,fe(z) 


I Pk 


ll z fc0fc|l?. 

I Si.fc(z) 


< 


| Sj,fc(z) 


I Pk 


Kfc(z) 


= 1 < 


\\ Z kPk\\p k 


Pk 


1 p k 


I Si,k(z) 


I Pk 


Kfc(z) 


< 00 , 


I p k 


follows from z £ S rf di . We only prove the inequality for r y i since the other inequality can be proved in the 
same way. By Lemmas [fi] and 15 for any l £ [to] \ {*} and any ji £ [d;] we have 


f-’pi ( G ( z ))^ 


> 




|s ijZ ( z ) 


-1 


n 


<j>k 


I Si,fc( z ) 


V’p; (( z )) ■ 


With tt—— 


n 

fce[m]\{z} 


^fee[m]\{i} 

< 1 and 1 < p'(m — 1 ) < Pk for every k £ [to] \ {i}, we get 


4>k 


Kfc( z ) 


I Pk 


p i (m— 1) —1 


> n 

fee[m]\{j} 


<t>k 


I Si,fc( z ) 


I Pk 


Pk -1 


=li ( z ) n 


fce[m]\{i} 


I s i,k{ z , 


11 gr 1 ’ 


Combining these facts shows that for every j 1 £ [di],... ,j m £ [d m ] holds 


li ( z ) - 11 


/e[m]\{i} 


V'pi ( s i,l,ji ( z )) 


i,i( z 


iipi-i 


n 

«6[m]\{i} 


(z 3 )) 1 


| Si,l ( z ) 


IPl 


n 

J6[m]\{.} 


Si,l,ji j G ( z )) 

, ( G < z »u, 


Pi-1 


19 


we know that 


Take the minimum over £ [d]J,... ,j m £ [d m ] to get r y i (z) < (G(z)). By Theorem 

7 ~(G(z)) < \\f\\ P jt™Jl < lt{ G ( z ))- This concludes the first step of our proof. Now, if (x fc )fc S n is the 


sequence produced by HGPM, then, by Corollary |10[ (x fe )fc S N C § 4+ ; since x° £ § 4+ ; by assumption. 
Moreover, note that x fc+1 = G(x fc ), A ^" 1 " 1 = ( 7 ~(x fc )) p 'i (m_1) and A 4 +1 = (p/tfx. k )) p i (m_1) for every k £ N. 


It follows that A^L < A ^. +1 < 


IPl,---,Pr, 


< A+ < A+ for every k £ N. Finally, if (A+ — A_) < e, subtracting 


from the inequality X h l_ < 


< A(v_, shows 


—£ < — 


Al - A 


< 


< 


Ai - A 


— ||J Mpi,...,p m — 


< £. 


□ 
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Now, we prove the convergence of the sequences produced by HGPM. 


Lemma 26. Let / > 0 be a weakly irreducible tensor and 1 < pi,... ,p m < oo such that there exists i G [m] 
with (to— l)p' < pk for all k G [m]\{/<}. Let x* G be a critical point of Qi and A := Qi(x*). Furthermore, 
consider the function F : y\ d ~ di —> y\ d ~ d i defined by F(x) := (.Fj(x),..., F m (x)) where for each k G M\W> 

Ffc(x) := A 1_p ^ p fe _1 )||x fc ||p(; + ^ m_1 ^^ 1_Pfc ' l+p s ij fe(x) and p > 0 is such that p[ + (to - l)p'(l - p[) + p > 0 for 
all l G [to] \ {«}. Let us denote by B the Jacobian matrix of F at x*. Then the function F is positively 
(p+ l)-homogeneous, B is primitive with Perron-root Ai := (p + 1)A and for any g, h G D\ d ~ di ,k G [to] \ {i}, 
we have 

(K \ Pk ~ 2 o h fc , (Sg) fc ) = <|x*r - 2 o g fc , (Bh) fc ) , 
where o denotes the Hadamard product and |y| 9 := {\yi\ q , ■ ■ ■, \y n \ q ) for y G M™, q G R. 


Proof. Since x* > 0, there exists some open neighborhood U C of x* such that is smooth 

on U for any k G [to] \ {«}. Existence of such a neighborhood is obvious since /(x) and V^/(x) are 
smooth on d\ d . Furthermore, / is weakly irreducible thus, by Proposition [8j we have d k j k f(x.) > 0 for any 


> 0 and ip p (t) is smooth on R \ {0}. With help of Lemma 15 it is straightforward to check that F is 
positively ( p+ l)-homogeneous. Let a k (x) := A 1_J fo p,fc_1 4|x/ c ||p];^” 1 ' 1 ^ p ^ 1 p ^ +p 5 then for every xGt/ and 
l G [to] \ {i}, we have V;a fc (x) = A 1 ”^^" 1 ) (p' k + {m-l)p\{\-p' k ) + p)\\x k \\ p p k k +{m ~ 1)pA1 ~ Pk)+p ~ Pk %f Pk (x k ) 


if l = k and ViCHfc(x) = 0 if k ^ l. In particular, 


s ++ 


thus VfcOfc(x*) > 0. Note that for every 


k,l G [to] \ {i},ji G [di\ and j k G [4], we have di tjl F ktjk (x) = s itk>jk (x)d ltjl a k (x) + a k (x)di ;jl s itktjk (x). 
Moreover, using {p' — 2) = (2 — p)(p' — 1) for 1 < p < oo, a tedious computation shows 


- 1U p'dp'k- 1 )- 2 


d i,ji s i,k,j k ( x *) =iPi - !)(Pk - !) A 

+ (p' k -l)\r'M-P-i\ 


1 * 12 Pk / 

>\ *t 

\ x kp k \ < 



2 -Pi 


oV l 9 I J(x*),V,5 tA /(x*) 


I 2 -p k 


'k,jk I 


d i,3i d k,j k f{x*) vfc, Z G [m], jk G [d k ),ji G [. di ]. 


In particular^ note that di :V Si_ k j k (x*) > 0 follows from / > 0 and x* > 0, thus B > 0 because Si, k ,j k {x*) > 0 
by Lemma pj cifc( x *) > 0 and d k j l a k (x*) > 0. From Equation ©> and x* G § d , we know that Si tk (x*) = 
\ pi(p' fc -i) x * > o and d k , jk a k {x*) = (p' k + (to - l)p'(l - p' k ) + p)X 1 ~ p ' i{p ' k ~ 1) 'ip Pk (x* kJk ) > 0, thus 


B(k,jk),( k Jk) ~ s i,k,jk ( x )4,4<3!fe(x ) + Ofc(x )d k ,l k Si,k,j k (x ) 

> 3i,kj k (x*)d k ,i k a k (x*) = A (p' k + (m- l)p'(l - p' k ) + p){x* kJk ) Pk > 0 

for all k G [to] \ {*} and j k , l k G [4]- This shows that the matrix B has strictly positive blocks of size d k x d k 
on its main diagonal. In order to prove that B is an irreducible matrix, we show that for every k, l G [to] \ {*} 
with k ^ l there exists j k G [ d k ] and ji G [fo] such that max B(i,ji),(k,j k )} > 0- This would 

imply that the graph associated to the adjacency matrix B is connected. Fix k,l G [to] \ {i} with k ^ l and 
suppose by contradiction that for every j k G [4] and every ji G [di\, we have 0 = 

It follows that di tjl s itkJk (x*) = 0 and dij l d k j k f(x.*) = 0 for every j k G [d k \,ji G [d{\. So, 0 = dijjfx*) = 
{x* k , V fe 4ji/(x*)} for every ji G [di], thus 0 = (x ; , V;/(x*)) = /(x*) = \\f\\ Pl ,...,p m , a contradiction. Hence 
the graph associated to the nonnegative adjacency matrix B is connected and B has strictly positive main 
diagonal entries, it follows from Lemma 8.5.5 and Theorem 8.5.2 in m that B is primitive. Now, using 
Sz,fe(x*) = A p d p fc -P x * it can be observed that F(x*) = Ax*. Approximating a H > F(ax*) linearly at 1 
shows a 1+p Ax* = a 1+p F(x*) = F(ax*) = F(x*) + (a — 1 )Bx* + o(a — 1) for every a > 1. Subtract 
Ax* + (a — l)Ux* on both sides and take the limit a —> 1 to get 


(a 1+p 

(1 + p) Ax* — Bx* = lim -- 

a 4,1 


l)Ax* — (a 
(a - 1) 


b^=o, 


i.e. (1 + p)X > 0 is the Perron-root of B associated to the strictly positive eigenvector x*. Now, we prove 
that (|x^| p ' l_2 o 4, (Bg)fc) = (|x£| Pfc-2 o g fc , (Hh)fc) . Since F is differentiable on U, for every h G we 
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have (Bh)k = (<5F(x*;h)) fc = SFkfx.*', h) where AF(x; h) :=lim e ^. 0 e 1 (F(x + eh) — F(x)) is the directional 
derivative of F at x in the direction h. The multiplication rule for directional derivative, x* £ and 

s,; jfc (x*) = A^-^x*, show 


^-Ffc(x*; h) = afc(x*)<5sj,fc(x*; h) + s ijfc (x*)i5afc(x*; h) = A 1 Pi(Pfc ^Ss it k(x*; h) + A p ‘ (p ' fe 1] x^ (Va fc (x*),h) 


Let C := A 1 p '^ p '>= ^ (p' k + (m- l)p'(l - Pk) + p), then 

(|x*r- 2 °g,,x* (Va fc (x*),h)) = C'(V’pfe( x k)>hfc) <Vw( x lfc);g fe ) = (|x^| Pfc - 2 o h fe ,x^ (Va fc (x*),g)) . 

In order to conclude the proof, we show (|x^| Pfc_2 o h*,, £sj,fc(x*; g)) = (|x£| Pfc_2 o g fc , <5s ijfe (x*; h)) . Another 

I 1 2 _ p k 

tedious computation shows 5s, i fc(x; h) = (p k — l)|sj i fc(x)| o L ij fc(x; h) for all x £ U where 


£j,fc(x,h) := E V fc /(xi,... ,x z _i,hi,x ;+ i,..., x»_i, W' (VJ(x)), x i+ i,... ,x m ) 

iG[m]\{/c,i} 

+W- 1 ) E V fc /(x 1 ,...,x i _ 1 ,|V,/(x)| p ’- 2 oV I /(x 1 ,...,x s —1 5 h-S 5 X s _|_l , • • • 1 Xm) 5 ^Q+l j • ■ • 5 Xm, ^ • 

sG[m]\{fc} 

Note that for any k, l £ [to] \ {*} with k ^ l holds 
(Vfc/(xi, . . . ,X;_i,h/,X i+ i 

5 • • • i Xm ),g k) = /(xi,...,x£_i,h £ ,xi + i,...,x fc _i,g fc ,x fc+ i 5 • • • i Xm) 

= (Vi/(X!,.. • ,x fc _i,g fc ,x fc+ i,... ,x m ),h ; ), 


furthermore for s £ [to] \ {i}, we have 

(V k f ( xi,... ,Xj_i, |Vj/(x)| Pi 2 o Vj/(xi,... ,x s _i,h s ,x s+1 j ■ • • 5 X m ) 5 X^-j-l5 ■ • • 5 X m ^ 5 §/c ^ 

( I . p'.—2 

Xi,... |V»/(x)| z O Vi/(x 1,... ,x s _i,h s ,x s+ i,... ,x m ),Xi+i,... ,x*_i,gfc,Xfc+i,... jX* 

= i/( x l, • • • , X/c—i, gfc, . • . , X m ), |Vi/(x)| Pi 2 O Vi/( Xl i • • • i Xs- 1 1 hs 5 X s _|_i, . . . , X m ) ^ 

= (|Vj/(x)| Pi_2 o V ) :/(xi,...,x fc _i,g fc ,x fe+ i,...,x m ),V s /(xi,...,x s _i,h s ,x s+ i,...,x m )) 

= (v s / ( xi,..., Xi_i, | Vj/(x) | Pi_2 o V Xi /(xi,..., x fe _i, g fc , x/. + i,..., x m ), x i+ i,..., x m ) , h s ^ . 

These relations imply (^^(x; h), g*,} = (L ij fe(x; g), hj,) for all x £ U. Thus, for every A; £ [to] \ {«}, we have 


<l’ 


.* |Pfc-2 


°gfc 


,<5s ijfc (x*;h)) = (p' fc - 1 )A p ^ (p ' e 2) (L i>fc (x;h),g fc ) = (|x£| Pfe 2 o h fe , 5s i)fc (x*; g)) . 


a 


Proposition 27. Let / > 0 a weakly irreducible tensor, 1 < pi,... ,p m < oo such that there is i £ [to] with 
(to. — l)p' < pk for every k £ [to] \ {*}, x* the unique strictly positive critical point of Qi in S d ~ di . Moreover, 
let DG(x’) be the Jacobian matrix of G at x* then the spectral radius of DG(x*) is strictly smaller than 
1, i.e. p(DG(x*)) < 1. 

Proof. Let B as in Lemma [26] then B is primitive and has Perron root Ai = {p + l )||/|| Pl ,..., Pm - Let d := 
di + ... + d m and Ai, ..., A d-di be the eigenvalues of B. We may order them so that Ai > |A 2 | > |A 3 | > ... > 
|A d-di\- We claim that |A 2 1 is the spectral radius p(M) of the matrix M := Ai_DG(x*). Let U C Jt+E an 
open neighborhood of x* such that F and G are smooth in U. Observe that Corollary [lOjimplies Ffe(x) > 0 for 

every x £ U and each k £ [to] \ {*}. Moreover, G(x) = ( ||jf(x^|| —> • • •, ^ for every x £ U and thus, 

in particular, G(x*) = x*. A straightforward computation shows that (Afh)j = ( Bh)i — ( Bh)i) 

for every l £ [to] \ {i} and every h £ d\ d ~ di . It follows that (Mx*)i = (5x*)i — x* (ip pi (xj 1 ), (Bx*)i) = 
Aix^ — Aix ; * (i/) pt (x ; *), x^) = 0, i.e. x* is an eigenvector of M associated to the eigenvalue 0. First, suppose 
that the eigenvalues of B are all distinct and different from 0. Now, from Proposition [26] we know that for 
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every h, g holds (|x£| Pfc 2 o h*,, (Bg) k ) = (|x£| Pfc 2 o g fe , ( Bh)k ) . For s £ [d], s > 2 let us denote by u s the 
eigenvector of B such that Bu s = A s u s , then 


A, (Vw(x£)X) = <l4r -2 ° (Bn s ) k ) = (Kr~ 2 o U%, (5x*) t > = A, <^ fc (xJ),<) 


From A s 7 ^ 0 and Ai 7 ^ X s follows {'>pp k (x k ), u£) = 0. This shows that for every k £ [m] \ {i} we have 
(Mu s ) fc = X s u s k - x*X s (ip Pk (x* k ),ul) = A s u|, i.e. A a is an eigenvalue of M associated to the eigenvector 
u s . Thus, the eigenvalues of M are exactly 0, A 2 ,..., Xd-di and we have p(M) = | A 2 1- It follows that 
p(DG(x*)) = < 1. The case when B does not satisfy the above assumption is treated as in Corollary 

5.2, HI]. 1 □ 

Corollary 28. Let f,pi ,... ,p m , x* and G as in Proposition 
ro > 0 and 0 < v < 1 such that for every y° £ y\ d ~ d i with ||j 


r k +1 


— X 


|G ^ 


<H|y'-x* 


Then, there exists a norm 
— x*|| G < r 0 we have 

Wk £ N, 


on 9L 


d—do 


(9) 


where y fe+1 := G(y k ) for every k £ N. 


Proof. Let U be an open neighborhood of x* such that G is differentiable on U and u > 0 for every u £ U. 
By Proposition 27 we know that p(DG(x*)) < 1, so let L, v > 0 such that p(DG(x*)) < L < v < 1. It is a 
classical result (see Lemma 5.6.10, ED]) that there exists a norm || • ||g on d\ d di such that for every v £ D\ d di 
holds ||DG(x*)v||g < L||v||g- Since G is differentiable at x*, we have G(u) = G(x*) + DG(x*)(u — x*) + 

II u.x* || G 


i?(u,x*), with lim„ 


= 0. Let e > 0 be such that e < v — L, then there is r 0 > 0 such that for 


every u £ S with ||u — x*||g < ro we have ||i?(u,x*) ||g < e|| u — x*||g- By decreasing ro if necessary, we 
may suppose that ||u — x*||g < tq implies u £ U. It follows that for every y° £ S d ~ di with ||y° — x*||g < ro, 
it holds 


l|y 1 - x*|| G = ||G(y°) - G(x*)||g = || J DG(x*)(y° - x*) + i?(u, x*)|| G 

< ||DG(x*)(y° - x*)|| G + ||i?(u,x*)|| G < (L + e)||y° - x*|| G < ^||y° - x*|| G . 

Since v < 1, we have Hy 1 — x*||g < ^||y° — x*|| G < ||y° — x*||g < r 0 . Thus we may apply recursively the 
above argument to get ||y fc+1 — x*|| G < v\\y k — x*|| G for every k £ N. □ 


It follows directly that if x° is close enough to the strictly positive singular vector x* of / (i.e. ||x°— x*|| G < 


ro with the notations of Corollary 281, the sequence (x fc )fc g ^ produced by HGPM has x* as its limit and the 
convergence rate is linear. However, this result is of little practical use if we don’t know x*. This is why 
we show now that for every x° £ the sequence (x k ) ke ^ converges to x*. In order to do it, we use a 

Lemma proved by R. Nussbaum Ell- 


Lemma 29 (Lemma 2.3, |2T]). Let (S,ps) t> e a metric space with metric ps an d suppose that Sq is a 
connected subset of S and p is a metric on Sq which gives the same topology on So as that inherited from 
S. Let T : So —> So be a map such that p(T(x), T(y)) < p(x, y) for every x, y £ So- For n £ N and x £ Sq, 
let T ra (x) := T" -1 (T(x)). Assume that there exists x* £ So and an open neighborhood U of x* such that 
U (~l £0 7 ^ 0 and lim^oo p s ( T n (x),x*) = 0 for every x £ U f! So- Finally, if there exists a continuous map 
ip : {t £ R | t > 0} —>• {t £ K | t > 0} with 99 ( 0 ) = 0 such that /xg(x,y) < y>(/z(x,y)) for all x,y £ U D Sq- 
Then limn^oo /rs(T n (x),x*) = 0 for every x £ So- 


We will apply Lemma 29 with So = S([. + di ,S = D\ d di ,ps{x, y) := ||x — y|| G , T = G and U = {x £ 
9\ d ~ di | ||x — x*|| G < ro} where || • || G and r 0 > 0 are such that Equation © is satisfied. Now, we build the 
metric p on So such that p(G(x),G( y)) < p(x, y) for x, y £ and prove that the topology on (E> d ff di , p) 

is the same as that inherited from (fR d ~ di , ps) ■ 
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Proposition 30. Let 1 < pi,... ,p m < oo, i £ [to] and p: S 


d—di ^ gd— d. 


( 


M x >y) : = ln 


n 


++ 


XI, 

max 


++ 
pi— i' 


defined by 


;e[m]\{i} min f ^h2L 


3l€[dl] \yiji 


Pi -1 


/ 


then (S+ + d ”, ^t) is a metric space. 

Proof. For l £ [to], let S+ + := jx; € K^ ! + | ||x;|| Pi = 1} and pi , pf , p+ : §^ + x S^ + —> ffi. with 


Ji6[dl] VKj, 


Xl 


Pi-1 


Mi (x;,yi) := min ,pj(x u yi) := max 


JiG[di] VJ/tii 


Xl 


’ 3l ' and pi(x h yi) '■= In ^ 


M; (xi,y;) 


( 10 ) 


It follows from Theorem 1.2 in izn that (§4_ ! +) /Ui) is a complete metric space. Note that §+ + ; = §+ + x ... x 
S++ 1 x S++ 1 x ... x S++ and p(x,y) = D;e[m]\{q ldi{ x i,yi), i- e - (§++*% m) is the product metric space of 
(§++, Mi)> • • • > (S++ 1 , Hi- 1 ), (S+ ! ^, m+ 1 ) > ■ • • > (§++, Mm) an d thus is a metric space itself. □ 

Proposition 31. Let / > 0 be a weakly irreducible and 1 < pi,... ,p m < oo are such that there is i £ [m] 
with (m — 1 )p' i < pk for all k £ [m}\ {i} and, if to = 2, choose i such that Pi < Vk for k £ [2] \ {*}. Let || • ||g 
be a norm such that Equation ([9]) is satisfied and p the metric of Proposition 30 Then, for every u £ , 

there exist r > 0 and c, C > 0 such that 


c||u — x||g < p(u, x) < C||u — x||g Vx £ {x £ 9\ d 


■ - u|| G < r} n§! 


'++ ■ 


Note that the assumption pi < pk for k £ [m] \ {i} when m = 2 is not restrictive by Remark 22 


Proof. Let l £ [to] \ {*} and v; £ §+ + , note that since R + —> M+: t t pi 1 is an increasing function (pi > 1 
by assumption), for every x;, y i £ R* + , we have 

,ji 

max —— 

JlGldl] Xl 31 

min 

ji£W yij t 

There exists fi > 0 such that B^(vi) C R+ + . Equation (1.21) in [2T] reads 


Pi - 1 


m(v^, x/) =: /I i(vi,xi) < ln 


&+||v Z -X;| 


PI 


& - II' v l - x l I 


Pi 


= ln 


1 + 


1 - 


Vx z e (vi). 


So, let t(xi) := 11 Vi and 0 < £; < &, then B l ei (v t ) C B^(vi) and we have /q(v;,x ; ) < ln for 

all x/ £ B l ei (vi). Now, the function h: [0, |(] —>• K., 1 1 —>• ln ^J i s continuously differentiable on [0, |j-] and 

2 < h'(t) = 2(1 — f 2 ) -1 < 2 ^1 — (e,/^) 2 ) for all t £ 0, |[ . It follows that h is a Lipschitz function and 
thus there exists ILi > 0 such that | h(t) — h(s)\ < K±\t — s| for every s,t £ [0, f 1 ]. Thus 


Pi(v h xi) < h(t(x[)) = | h(t(xi)) - h( 0)| < K^tfxi) - t(v z )| = ^||x ; - v /llp; Vx* £ B l ei (wi). 
In Equation (1.20) in (2fT] it is shown 

Il x ; -y/||p, < 3^e w(xi >yi) _ lj, Vx ; ,y ; £ S+‘ + . 


( 11 ) 
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In particular, as shown above, for every x; G B l ei (yi) we have /z(v;,x;) < and the function t i—>• e* is 
Lipschitz on [0, ^p-] (as it smooth and the derivative is bounded on the interval). So, there exists K 2 > 0 
such that \e s — e t \ < ^-|s — t\ for every s, t G [0, ^p] ■ It follows that 


X; - V;|| PJ < 3|e Mi(v, ’ Xi) - 3e°| < K 2 \pi(vi,xi) - 0| = K 2 fn(vi,xi) Vx ; G S+ ! + n B l ei (vi). 

we get 


Now, with K := maxji^, ^ Pl ^ Kl }, since pi > 2 for l G [m] \ {z} by Remark 
||x; - V/|| pi < K(pi - 1 )/h(v Z ,X Z ) = A>;(v ; ,X Z ) < A' 2 ||x/ - Vi|| pi 
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Vx,GS$ + nB‘ (v,). 


So, for every l G [m]\{z} there exists r; > 0 and C; > 0 such that ||u; — X;|| Pi < C;/x;(x ; ,uj) < C ; 2 ||u; — x ; || P( 
for all x; G B l ri (ui) D §++• Now, note that ||v|| p := Xwg[ m ]\{i} ll v i||pi I s a norm on d\ d ~ di . Since all norms 
are equivalent on finite dimensional spaces, there exists a constant Co such that ||v|| p < Co||v|| G < Co||v|| p 
for every v G 9i d_di . Let r = min/ e [ m ]\{q and C = C'o maxj e [ m ]\{j} Cj, then for all x G {z G 0\ d ~ di \ 
||z — u|| G < r} n§++ di we have ||x; — u;|| Pi < ||x — u|j p < Cq||x — u|| G < U for every l G [m\ \ {z}, and thus 


|u - x|| G < C 0 ||u - x|| p < C 0 Y Cz/ri(u;,Xi) < C/Lt(u,x) = C Y /q( u G x z) 

ZG[m]\{i} Z£[m]\{i} 

<C Y ^IK -x z || Pl < C||u-x|| p max: C; < C 2 ||u-x|| G . 


Divide the inequality by C to conclude the proof. 


□ 


Now, we prove that G is non-expansive with respect to the metric p defined in Proposition |30| 


Proposition 32. Let / > 0 a weakly irreducible tensor, 1 < pi,... ,p m < 00 such that there is i G [m] with 
(m — 1 )p' i < pk for every k G [to] \ {z} and p defined as in Proposition 30 then for every x, y G Splj. * we 
have /i(G(x),G(y)) < /z(x,y). 

Proof. For l G [m] \ {*}, let 0; := min iie[di] ^ and := max j|£[dl ] Note that ||x/|| Pi = ||yz|| PI = 1 

implies </>;<!< pi- By Lemmas[6]and 15 for every l G [to] \ {z} and ji G [di\ we have 


Pi / \ Pi 

*( II ^) ( s bth(y )) P!_1 < ( s *,ij i ( x )) p '” 1 < pT 1 ( II ( s bth(y)) 

\fce[m]\{i} / 


\PI-1 ^ t f \\PI - 1 

9k I [spijpyj 

yk£[m]\{i} 

It follows that for every j\ G [c?i], ..., j m G [d m \ we have 


pi-i 


ZPl-l 


< 


n 91 - 

ZG[m]\{i} ZG[m]\{i} 


n (358) 


pi —1 


< n ^ 

ie[m]\{i} 


PI-1 


where we have used <f>i < 1 < tpi and 1 < p[(m — 1) < pi for every l G [to] \ {z}. Thus, 


oM (G(x),G(y)) _ 'gMUO 


TT max . , 

- L - L jie[di] \ s i,tii(y)/ 


pi-i 


mm 


•V'.ii( x )\ 
heldi] V s i,tji(y)/ 


-T- < 

PI-1 “ 


n « 

ig[m]\{i}_ 

n *r l 


= e p( x ,y) 


the desired inequality follows from the fact that 1 1 —> ln(t) is an increasing function. 


□ 
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Now, let us prove the convergence of the sequences produced by HGPM. Note that Theorem[2]is a direct 
consequence of the next Theorem. 


Theorem 33. Let / > 0 be weakly irreducible and 1 < pi,... ,p m < oo such that there is i £ [m] with 
(m — 1 )p[ < pk for all k £ [m] \ {*} and, if to = 2, choose i such that pi < pk for k £ [2] \ {?'}. Let 
x* £ § d_di be the unique strictly positive critical point of Qi in Let (\ k _)ken, (A(j_)fc g N C R and 

(x fc )fe £ N C S d_di be the sequences produced by HGPM. Then (x k )ken converges to x*, (A(L)fc £ N, (A X)ken 
and (Qi(x fc )) fegN converge to ||/|| Pl ,..., Pm and there is a norm || ■ ||g on 93 d_di ,0 < v < 1 and Ato £ N such 
that ||x fc+1 - x*|| G < v\\x k - x*|| G for all k > k 0 . 


Proof. First, we prove that (x fc )*, e N converges to x*. Let || • ||g be the norm defined in Corollary 28 and 


ps '■ 93 d di x 93 d di —> R the metric defined by ps(x, y) := ||x — y||G- Note that S d + di C 93 d di is connected 


30 


then p is a metric on S}, d ’. Moreover, Proposition 31 implies that 


and if p is defined as in Proposition 

the topology induced by p on 8 d + * is the same as that inherited from (9 < K d ~ di 1 ps). By Corollary 
know the existence of some rg > 0 and 0 < v < 1 such that for every y° £ 93 d ^ di with ||y° — x*||g < rg nolds 


28 


we 


lim ps( y fe ,x*)= lim ||y fe — x* 

k—¥ oo k—> oo 


|g < lim ^ fc ||y° - x*||g = 0 where y fc+1 := G(y fc ) Vfc £ N. 

k—¥ oo 


Now, let ||v||p := X^e[ml\{i} H v dU> Mi defined as in Equation (101 and C > 0 such that 


|g < G||v||p for 


, , _ / p-i( x i> yQ 

every v £ 93 d_d £ From Equation (11) we know that ||xj — z;|| Pi < 31 e p i _1 — 1) for every X;,y i £ 


with ||x/|| pi = ||y/|| pi = 1. By Remark |22| we know that Pk > 2 for all k £ [m] \ {*}• It follows that for every 
x,y £ S d f^ ii D {z £ 93 d_di | || z — x*|| G < r 0 } we have 


||x-y|| G < G||x-y|| p < C ^ 

i£[m]\{i} 

< 3 C(m- 1) (e^'«w\w 


mt( x z >yz) 

3 ( e Pi" 1 - 


Pi(xi.yi) 


1 j < C ^2 3 (e w(xi ’ yi) - l) 

-1^ = 3C(m-l)(e /l(x - y > -1). 


In particular, the function ip : {t £ R | t > 0} —» {t £ R | t > 0} defined by = 3C(m — l)(e 4 — l) is 
continuous and satisfies 93 ( 0 ) = 0. Finally, note that by Proposition[32|we know that p,(G(x), G(y)) < m( x , y) 


for every x, y £ S d 1|_ ’. So, we may apply Lemma 29 and ensure that lim^oo p(x* ,x k ) = 0 for every choice 
of x° £ § d ^ d % i.e. (x fc )/ se N converges to x* £ S d "^. L From TheoremjlJ we know that ||/|| P i,..., Pm = Qi(x*) 
and since 7 “, 7 , + and Qi are continuous functions on S d £ di , we have 


lim A* = lim ( 7 +(x fe ))^ ( - 1) = ( 7 +(x*))*- l > = 

k—> oo k — ^00 


\Pl,---,Prr 


= lim ( 7 r(x fc )) p l (m - 1> = lim A 

k -¥oo v 2 7 u 


k —^00 


k 

— 5 


and lim^oc Qi(x k ) = Qi(x*) = 


\\P1,...,P ? 


, . Finally, since (x k )keN converges to x*, there exists k 0 > 0 such 


that ||x fe — x*||g < r 0 for every k > k 0 and thus ||x fc+1 — x*||g < v\\x k — x*||g for every k > k 0 . 


□ 


7 Experiments 

We compare the HGPM with the Power Method (PM) proposed by Friedland et al. in |TT]. The PM com¬ 
putes the singular values of nonnegative weakly irreducible tensors for the special case pi = ... = p m . The se¬ 
quence (v fc ) feeN C 93 d produced by this algorithm can be formulated as w fe+1 = (cr 1 (v fc ),... ,cr m (v fe )),v fc+1 = 
y A . for k > 1 and some vector n £ 93 d with n > 0. For all our experiments we took n = (1,1,..., 1) 
and v° = £ 93 d and x° = ( nJ 1 ^ 1 ’"^|j —,..., ^ £ 93 d_di as starting points. Plots show 
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Figure 1: Plot of the error |Q(v},..., vj^) — Q(x*) | (in green) 
and the error | q ( x }, ..., xjLj, cri(x. k ), x{ +1 ,..., x, fc n ) -Q(x*)| 
(in blue) versus the number of iterations fcona semilogarithmic 
scale. 


Figure 2: Plot of the error ||v fc — x* 11 2 (in green) and the error 
|| (xj,... ,xJ_ 1 ,o- i (x fc ),x i fc +1 ,... ,x^) - x*|| 2 (in blue) versus 
the number of iterations k on a semilogarithmic scale.. 


linear convergence as stated in Theorem |33| Numerical experiments on randomly generated tensors showed 
that HGPM converges usually quicker than PM. Note also that the computation of one iteration of HGPM 
requires to go two times over all entries of / while PM requires it only one time. In Figure [2] we show the 
convergence rate of both algorithms for p = pi = ... = p m £ {3,4,5} and the weakly irreducible tensor 

/ £ R 2x3x4 by 


/i, 2 ,i — 806, /i, 3 ,i — 761, /i, 3,4 — 3, / 2 ,i,i — 833, — 285, .{ 2 , 3,3 — 176 and fji,j 2 ,j 3 — 0 e l se - 
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